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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a drive recorder that employs a single camera 
to monitor 360 degrees around a vehicle and, should an accident occur, provides a 
record of conditions surrounding the vehicle when the accident occurs to permit 
identification of a correct cause of the accident. 

SOLUTION: This drive recorder includes an all-direction vision sensor (HyperOmni 
Vision) 12 that is installed so that it can observe 360 degrees around the vehicle as 
well as the driver. The HyperOmni Vision 12 includes a hyperbolic mirror 8 which is 
mounted perpendicularly facing downward and a camera 4 whose visual line is aligned 
with the center axis of the hyperbolic mirror 8 and which is mounted perpendicularly 
facing upward. The drive recorder further includes an A/D converter 40 that receives 
analog outputs from the camera 4, a monitor 48 that displays the image pictured by 
the camera 4. and a recording device 42 that records image data output from the 
camera 4. together with vehicle speed, brake condition, yaw rate, acceleration, and 
steering condition and the like. 

* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A drive recorder comprising: 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has said camera and a 
predetermined relation, and condenses an image of an omnidirection to said camera. 
A recorder which is connected to said camera and records said image. 

[Claim 2]The drive recorder according to claim 1 which said recorder is connected to 



said camera and said traveling condition output means, and contains a device which 
matches and records said image and said traveling condition including further a 
traveling condition output means which outputs a traveling condition of said vehicles. 
[Claim 3]The drive recorder according to claim 1 or 2 which is connected to said 
camera and contains further a monitoring device which displays an output of said 
camera. 

[Claim 4]The drive recorder according to any one of claims 1 to 3 which said 
condensing means is arranged at a position which has said camera and a 
predetermined relation, and contains a mirror which makes the convex side of a solid 
of revolution a mirror plane. 

[Claim 5]The drive recorder according to claim 4 In which said mirror is a hyperboloid 
mirror. 

[Claim 6]The drive recorder according to any one of claims 1 to 3 in which said 
condensing means contains said camera and a fish-eye lens arranged at a position 
which has a predetermined relation. 

[Claim 7]A safety operation supporting system comprising: 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has said camera and a 
predetermined relation, and condenses an image of an omnidirection to said camera. 
An image processing device which changes said image which is connected to said 
camera and outputted from said camera in accordance with a method which was able 
to be defined beforehand. 

A recorder which records said image which was connected to said image processing 
device and changed in accordance with said method defined beforehand, and a 
monitoring device which displays said image which was connected to said image 
processing device and changed in accordance with said method defined beforehand. 

[Claim 8]Including further a traveling condition output means which outputs a traveling 
condition of said vehicles said recorder, The safety operation supporting system 
according to claim 7 which is connected to said image processing device and said 
traveling condition output means, and contains a device which matches and records 
said image changed in accordance with said method defined beforehand, and said 
traveling condition. 

[Claim 9]A safety operation supporting system comprising: 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has said camera and a 
predetermined relation, and condenses an image of an omnidirection to said camera. 
A front environment recognition means for it to be connected to said camera and to 
recognize front environment of said vehicles from an output of said camera. 
An alarm outputting means which is connected to said camera, is connected to a 



driver state recognition means to recognize a state of a driver from an output of said 
camera, and said front environment recognition means and said driver state 
recognition means, and outputs a predetermined alarm according to an output of said 
front environment recognition means and said driver state recognition means. 

[Claim 10]The safety operation supporting system according to claim 9 containing a 
means for said driver state recognition means to be connected to said camera, to 
recognize that said driver is dozing from an output of said camera, and to output a nap 
signal. 

[Claim 1 1]A safety operation supporting system comprising: 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has said camera and a 
predetermined relation, and condenses an image of an omnidirection to said camera. 
A front environment recognition means for it to be connected to said camera and to 
recognize front environment of said vehicles from an output of said camera. 
A driver state recognition means for it to be connected to said camera and to 
recognize a state of a driver from an output of said camera, A traveling control means 
which is connected to said front environment recognition means and said driver state 
recognition means, and performs traveling control of said body according to an output 
of said front environment recognition means and said driver state recognition means. 

[Claim 12]The safety operation supporting system according to claim 1 1 containing a 
means for said driver state recognition means to be connected to said camera, to 
recognize that said driver is dozing from an output of said camera, and to output a nap 
signal. 

[Claim 13]The safety operation supporting system according to claim 11 or 12 which 
said traveling control means is connected to said front environment recognition 
means and said driver state recognition means, and contains a brake control means 
which controls a brake according to an output of said front environment recognition 
means and said driver state recognition means. 

[Claim 14]Said traveling control means is connected to said front environment 
recognition means and said driver state recognition means. The safety operation 
supporting system according to claim 11 or 12 which contains a steering control 
means which controls a steering according to an output of said front environment 
recognition means and said driver state recognition means. 
[Claim 1 5]A safety operation supporting system comprising: 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has said camera and a 
predetermined relation, and condenses an image of an omnidirection to said camera. 
A peripheral environment recognition means for it to be connected to said camera and 



to recognize surrounding environment. 

An alarm outputting means which is connected to a traveling condition output means 
which outputs a traveling condition of said vehicles, and said peripheral environment 
recognition means and said traveling condition output means, and outputs a 
predetermined alarm according to an output of said peripheral environment 
recognition means and said traveling condition output means. 

[Claim 16]A safety operation supporting system comprising: 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has said camera and a 
predetermined relation, and condenses an image of an omnidirection to said camera. 
A peripheral environment recognition means for it to be connected to said camera and 
to recognize surrounding environment. 

A traveling control means which is connected to a traveling condition output means 
which outputs a traveling condition of said vehicles, and said peripheral environment 
recognition means and said traveling condition output means, and performs traveling 
control of said body according to an output of said peripheral environment recognition 
means and said traveling condition output means. 

[Claim 17]The safety operation supporting system according to claim 16 which said 
traveling control means is connected to said peripheral environment recognition 
means and said traveling condition output means, and contains a brake control means 
which controls a brake according to an output of said peripheral environment 
recognition means and said traveling condition output means. 

[Claim 18]The safety operation supporting system according to claim 16 which said 
traveling control means is connected to said peripheral environment recognition 
means and said traveling condition output means, and contains a steering control 
means which controls a steering according to an output of said peripheral 
environment recognition means and said traveling condition output means. 
[Claim 19]The safety operation supporting system according to any one of claims 15 
to 18 which is connected to said peripheral environment recognition means and said 
traveling condition output means, and contains further a recorder which records an 
output of said peripheral environment recognition means and said traveling condition 
output means. 

[Claim 20]The safety operation supporting system according to any one of claims 7 to 
19 which said condensing means is arranged at a position which has said camera and a 
predetermined relation, and contains a mirror which makes the convex side of a solid 
of revolution a mirror plane. 

[Claim 21]The safety operation supporting system according to claim 20 in which said 
mirror is a hyperboloid mirror. 



[Claim 22]The safety operation supporting system according to any one of claims 7 to 
19 with which said condensing means contains said camera and a fish-eye lens 
arranged at a position which has a predetermined relation. 
[Claim 23]Anti-theft system comprising: 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has said camera and a 
predetermined relation, and condenses an image of an omnidirection to said camera. 
A suspicious person decision means which judges whether it is connected to said 
camera and a suspicious person is near the vehicles. 

An entrainment decision means which judges whether there are those who were 
connected to said camera and have taken vehicles, A physical action decision means 
which judges whether a physical action is added to said vehicles, An alarm judging 
means which judges whether it is connected to said suspicious person decision means, 
said entrainment decision means, and said physical action decision means, and an 
alarm is outputted according to an output of said suspicious person decision means, 
said entrainment decision means, and said physical action decision means. An alarm 
outputting means which is connected to said alarm judging means and outputs a 
predetermined alarm according to an output of said alarm judging means. 

[Claim 24]The anti-theft system according to claim 23 with which said physical action 
decision means includes a vehicle vibration decision means which judges whether 
vibration is added to said vehicles. 

[Claim 25]The anti-theft system according to claim 23 with which said physical action 
decision means includes a locked state decision means which judges a locked state of 
said vehicles. 

[Claim 26]The anti-theft system according to any one of claims 23 to 25 which is 
connected to said camera and contains further a recorder which records said image. 
[Claim 27]The anti-theft system according to claim 26 which said recorder is 
connected to said camera and said suspicious person decision means, and contains a 
device which records an output of said image and said suspicious person decision 
means. 

[Claim 28]The anti-theft system according to claim 26 which said recorder is 
connected to said camera and said physical action decision means, and contains a 
device which records an output of said image and said physical action decision means. 
[Claim 29]Said recorder Said camera, said suspicious person decision means, said 
entrainment decision means, The anti-theft system according to claim 26 which is 
connected to said physical action decision means and said alarm judging means, and 
contains a device which records an output of said image and said suspicious person 
decision means, said entrainment decision means, said physical action decision means, 
and said alarm judging means. 



[Claim 30]The anti-theft system according to any one of claims 23 to 29 which said 
condensing means is arranged at a position which has said camera and a 
predetermined relation, and contains a mirror which makes the convex side of a solid 
of revolution a mirror plane. 

[Claim 31]The anti-theft system according to claim 30 in which said mirror is a 
hyperboloid mirror. 

[Claim 32]The anti-theft system according to any one of claims 23 to 29 with which 
said condensing means contains said camera and a fish-eye lens arranged at a 
position which has a predetermined relation. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention about the drive recorder, the safety operation 
supporting system, and anti-theft system of vehicles, The image of the 360 
circumferences (it is called an "omnidirection" in this specification.) is especially 
picturized with one camera, It is related with the drive recorder which memorizes the 
picturized image, the safety operation supporting system which supports a safety 
operation of a driver from the picturized picture, and the anti-theft system which can 
prevent the theft of vehicles from the picturized picture. 
[0002] 

[Description of the Prior Art]Aiming at realization of the road transportation system 
of the next generation safe, comfortable in recent years, and efficient, ****** is 
promoting research and development of ITS (Intelligent TransportSystems) which is a 
national project from each position. As one field of ITS, development of the safety 
operation supporting system aiming at the driving support of a driver is also furthered. 
Based on the information acquired by mounted sensors, such as a CCD camera, and 
the information provided from the infrastructure side by communication between 
highway and vehicle, this safety operation supporting system emits dangerous warning 
to a driver, or performs operation assistance. 

[0003]As an example, the safety operation supporting system whose artificer of the 
invention in this application is one of joint inventors is indicated in detail by AHS 
safe running system besides temple Toshi Kubo development-", and SEI technical 
review No. 151 pp.47-52 (1997)/' With reference to drawing 21 , the camera 4 installed 
in the front face of the vehicles 14 picturizes a self-vehicle front image with this 
safety operation supporting system. The picturized picture is processed by an image 
processing portion (not shown), and recognition of precedence vehicles, a running 



route, and the road sign 18 is performed. Dangerous warning and operation assistance 
are performed according to a recognition result. Thereby, the driver (not shown) can 
perform safe running. The image picturized with the camera 4 is recorded on a 
recorder (not shown). For this reason, even if it is a case where an accident should 
happen, it becomes easy to trace the cause of an accident. 

[0004]."Toshio Ito et.al, "Ominidirectional Vision Sensor for Intelligent Vihicles", 1998 
IEEE International Conference on To IntelligentVehicles and pp. 365-370." A crew 
member's number is detected from the image which picturized and picturized the 
image of the omnidirection besides in the car combining a fish-eye lens or a 
hyperboloid mirror, and a camera, or the system which changes the picturized image 
into the image which does not have distortion so that a driver may be legible is 
indicated. 
[0005] 

[Problem(s) to be Solved by the Invention] However, in the above-mentioned safety 
operation supporting system, the field area of the camera 4 is limited ahead of the 
vehicles 14. For this reason, the state of a driver cannot be supervised but the timing 
of dangerous warning or operation assistance may be overdue. For example, even if 
the driver is dozing off while driving, dangerous warning etc. cannot be performed until 
it begins meandering operation. 

[0006]On the other hand, if the state of a driver can be supervised, dangerous warning 
etc. can be performed before a meandering start up, and a driver can be run more 
safely. Although what is necessary is just to form the camera for driver surveillance 
further in order to supervise the state of a driver, the number of a camera will be two 
sets. For this reason, a manufacturing cost will become large. In order to carry out the 
real-time operation of the picture of two sheets picturized with two cameras, it will be 
necessary to make performance of an image processing portion higher, and a 
manufacturing cost will become large similarly. 

[0007]In an above-mentioned safety operation supporting system, although the image 
ahead of the vehicles 14 is recorded on the recorder, the image of the side and back 
and the image of the driver are not recorded. For this reason, a case as other vehicles 
clashed from behind from the side or back, and when the driver is dozing off while 
driving, it becomes difficult to study that accident cause. 

[0008] Furthermore, "Toshio Ito etal, "Ominidirectional Vision Sensor for Intelligent 
Vihicles", and 1998 IEEE International. In the system currently indicated by 
Conference on Intelligent Vehicles and pp. 365-370", a driver can change the image of 
an omnidirection so that it may be legible. However, from the image, obstacles, such 
as the other car, are discovered and it is not indicated about art which controls 
operation automatically. 

[0009]With two above-mentioned systems, in the state where people are not on 
vehicles, even if it is a case where a suspicious person tends to steal the thing in 



vehicles, it cannot be prevented further again. 

[0010]Were made in order that **** might solve this invention, and the purpose, Even 
if it is a case where the omnidirection of vehicles should have been supervised with 
one camera and an accident should happen, it is providing the drive recorder which 
can grasp the situation of not only a vehicle front but the side and back, and the 
situation of a driver, and can study an accident cause correctly. 

[001 IJWhile other purposes of this invention support a safety operation of a driver by 
picturizing the image of the omnidirection of vehicles, changing the picturized picture 
into the legible image of a driver, and showing it with one camera, Even if it is a case 
where an accident should happen, it is providing the safety operation supporting 
system which can grasp the situation of not only a vehicle front but the side and back, 
and can study an accident cause correctly. 

[0012]The purpose of further others of this invention is to provide the safety 
operation supporting system which performs state recognition of a driver, and the 
front surveillance of vehicles with one camera, and supports a safety operation of a 
driver. 

[0013]The purpose of further others of this invention is to provide the safety 
operation supporting system which performs state recognition of a driver, and the 
front surveillance of vehicles with one camera, prevents the nap of a driver, and 
supports a safety operation of a driver. 

[0014]The purpose of further others of this invention is to provide the safety 
operation supporting system which supervises the omnidirection of vehicles with one 
camera and supports a safety operation of a driver. 

[0015]The purpose of further others of this invention is to provide the anti-theft 
system which can prevent it, even if it is in the state where people are not on vehicles 
and is a case where a suspicious person tends to steal the thing in vehicles. 
[0016] 

[Means for Solving the Problem]A drive recorder concerning the invention according 
to claim 1 is provided with the following. 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has a camera and a 
predetermined relation, and condenses an image of an omnidirection to a camera. 
A recorder which is connected to a camera and records an image. 

[001 7] According to the invention according to claim 1. an image acquired from an 
output of one camera picturizes an omnidirection. This image is recorded on a 
recorder. For this reason, when an accident etc. happen, by reproducing an image 
recorded on a recorder, a situation of not only a vehicle front but the side and back 
and a situation of a driver can be grasped, and an accident cause can be studied 
correctly. 



[0018]Including further a traveling condition output means which outputs [ in the 
invention according to claim 2 ] a traveling condition of vehicles in addition to 
composition of the invention according to claim 1, it is connected to a camera and a 
traveling condition output means, and a recorder contains a device which matches and 
records an image and a traveling condition. 

[0019]Since in addition to an operation of the invention according to claim 1, and an 
effect speed of vehicles, etc. double and are recorded on a recorder, the invention 
according to claim 2 can grasp a situation at the time of an accident etc. happening 
correctly. 

[0020]In addition to composition of the invention according to claim 1 or 2, it is 
connected to a camera and the invention according to claim 3 contains further a 
monitoring device which displays an output of a camera. 

[0021 ]The driver can recognize the surrounding situation in an instant by carrying out 
[ as for the invention according to claim 3 ] the monitor display of the output of a 
camera in addition to an operation of the invention according to claim 1 or 2, and an 
effect. For this reason, a safety operation of a driver is supportable. 
[0022]In addition to composition of the invention according to any one of claims 1 to 3, 
a condensing means is arranged at a position which has a camera and a predetermined 
relation, and the invention according to claim 4 contains a mirror which makes the 
convex side of a solid of revolution a mirror plane. 

[0023]In addition to composition of the invention according to claim 4, a mirror of the 
invention according to claim 5 is a hyperboloid mirror. 

[0024]In addition to composition of the invention according to any one of claims 1 to 3, 
the invention according to claim 6 contains a fish-eye lens with which it has been 
arranged at a position which has a relation a camera and predetermined in a 
condensing means. 

[0025]A safety operation supporting system concerning the invention according to 
claim 7 is provided with the following. 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has a camera and a 
predetermined relation, and condenses an image of an omnidirection to a camera. 
An image processing device which changes an image which is connected to a camera 
and outputted from a camera in accordance with a method which was able to be 
defined beforehand. 

A recorder which records an image changed in accordance with a method which was 
connected to an image processing device and defined beforehand, and a monitoring 
device which displays an image changed in accordance with a method which was 
connected to an image processing device and defined beforehand. 

[0026]According to the invention according to claim 7, although an image acquired 



from an output of one camera picturizes an omnidirection, it may not necessarily be 
an image legible to a driver. For this reason, when an image processing device changes 
into a legible image of a driver an image picturized with a camera, it can express as a 
legible method of a driver. For this reason, the driver can recognize the surrounding 
situation in an instant. Thereby, a safety operation of a driver is supportable. A picture 
of an omnidirection changed into a legible method of a driver is recorded on a recorder. 
For this reason, when an accident etc. happen, by reproducing an image recorded on a 
recorder, a situation of not only a vehicle front but the side and back can be grasped, 
and an accident cause can be studied correctly. 

[0027]The invention according to claim 8. including further a traveling condition output 
means which outputs a traveling condition of vehicles in addition to composition of the 
invention according to claim 7 a recorder, It is connected to an image processing 
device and a traveling condition output means, and a device which matches and 
records an image and a traveling condition which were changed in accordance with a 
method defined beforehand is included. 

[0028]Since in addition to an operation of the invention according to claim 7, and an 
effect speed of vehicles, etc. double and are recorded on a recorder, the invention 
according to claim 8 can grasp a situation at the time of an accident etc. happening 
correctly. 

[0029]A safety operation supporting system concerning the invention according to 
claim 9 is provided with the following. 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has a camera and a 
predetermined relation, and condenses an image of an omnidirection to a camera. 
A front environment recognition means for it to be connected to a camera and to 
recognize front environment of vehicles from an output of a camera. 
An alarm outputting means which is connected to a camera, is connected to a driver 
state recognition means to recognize a state of a driver from an output of a camera, 
and a front environment recognition means and a driver state recognition means, and 
outputs a predetermined alarm according to an output of a front environment 
recognition means and a driver state recognition means. 

[0030]According to the invention according to claim 9. image data obtained from an 
output of one camera picturizes an omnidirection. Front environment recognition of 
vehicles and state recognition of a driver are performed using this image data, and a 
predetermined alarm is outputted according to these recognition results. For this 
reason, one camera can perform state recognition of a driver, and front surveillance of 
vehicles, and a safety operation of a driver can be supported. 

[0031 ]In addition to composition of the invention according to claim 9, it is connected 
to a camera and, as for the invention according to claim 1 0, a driver state recognition 



means contains a means to recognize that a driver is dozing from an output of a 
camera and to output a nap signal. 

[0032]In addition to an operation of the invention according to claim 9, and an effect, 
the invention according to claim 10 outputs an alarm, when a driver is dozing off while 
driving. For this reason, a dozing off while driving of a driver can be prevented. 
[0033]A safety operation supporting system concerning the invention according to 
claim 1 1 is provided with the following. 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has a camera and a 
predetermined relation, and condenses an image of an omnidirection to a camera. 
A front environment recognition means for it to be connected to a camera and to 
recognize front environment of vehicles from an output of a camera. 
A traveling control means which is connected to a camera, is connected to a driver 
state recognition means to recognize a state of a driver from an output of a camera, 
and a front environment recognition means and a driver state recognition means, and 
performs traveling control of the body according to an output of a front environment 
recognition means and a driver state recognition means. 

[0034]According to the invention according to claim 1 1, image data obtained from an 
output of one camera picturizes an omnidirection. Front environment recognition of 
vehicles and state recognition of a driver are performed using this image data, and 
traveling control of the body is performed according to these recognition results. For 
this reason, one camera can perform state recognition of a driver, and front 
surveillance of vehicles, and a safety operation of a driver can be supported. 
[0035]In addition to composition of the invention according to claim 11, it is 
connected to a camera and. as for the invention according to claim 12, a driver state 
recognition means contains a means to recognize that a driver is dozing from an 
output of a camera and to output a nap signal. 

[0036]In addition to an operation of the invention according to claim 1 1, and an effect, 
the invention according to claim 12 performs traveling control, when a driver is dozing 
off while driving. For this reason, an accident can be prevented even if a driver is 
dozing off while driving. 

[0037]In addition to composition of the invention according to claim 11 or 12, a 
traveling control means is connected to a front environment recognition means and a 
driver state recognition means, and the invention according to claim 13 contains a 
brake control means which controls a brake according to an output of a front 
environment recognition means and a driver state recognition means. 
[0038]Image data from which the invention according to claim 13 is obtained from an 
output of one camera in addition to an operation of the invention according to claim 1 1 
or 12 and an effect picturizes an omnidirection. Front environment recognition of 



vehicles and state recognition of a driver are performed using this image data, and 
control of a brake is performed according to these recognition results. For this reason, 
one camera can perform state recognition of a driver, and front surveillance of 
vehicles, and a safety operation of a driver can be supported. 

[0039]The invention according to claim 14 in composition of the invention according 
to claim 11 or 12 in addition, a traveling control means, It is connected to a front 
environment recognition means and a driver state recognition means, and a steering 
control means which controls a steering is included according to an output of a front 
environment recognition means and a driver state recognition means. 
[0040]Image data from which the invention according to claim 14 is obtained from an 
output of one camera in addition to an operation of the invention according to claim 1 1 
or 12 and an effect picturizes an omnidirection. Front environment recognition of 
vehicles and state recognition of a driver are performed using this image data, and 
control of a steering is performed according to these recognition results. For this 
reason, one camera can perform state recognition of a driver, and front surveillance of 
vehicles, and a safety operation of a driver can be supported. 

[0041 ]A safety operation supporting system concerning the invention according to 
claim 15 is provided with the following. 
One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has a camera and a 
predetermined relation, and condenses an image of an omnidirection to a camera. 
A peripheral environment recognition means for it to be connected to a camera and to 
recognize surrounding environment. 

An alarm outputting means which is connected to a traveling condition output means 
which outputs a traveling condition of vehicles, and a peripheral environment 
recognition means and a traveling condition output means, and outputs a 
predetermined alarm according to an output of a peripheral environment recognition 
means and a traveling condition output means. 

[0042]According to the invention according to claim 15. image data obtained from an 
output of one camera picturizes an omnidirection. Surrounding environment 
recognition of vehicles is performed using this image data. For this reason, in spite of 
an obstacle's having fallen on the side of vehicles or locating in it the other car which 
approaches from rear side of vehicles, when it is going to change lanes, a 
predetermined alarm is outputted according to these recognition results. Thereby, 
front and rear, right and left of vehicles can be supervised with one camera, and a 
safety operation of a driver can be supported. 

[0043]A safety operation supporting system concerning the invention according to 
claim 16 is provided with the following. 
One camera ****(ed) by vehicles. 



A condensing means which is arranged at a position which has a camera and a 
predetermined relation, and condenses an image of an omnidirection to a camera. 
A peripheral environment recognition means for it to be connected to a camera and to 
recognize surrounding environment. 

A traveling control means which is connected to a traveling condition output means 
which outputs a traveling condition of vehicles, and a peripheral environment 
recognition means and a traveling condition output means, and performs traveling 
control of the body according to an output of a peripheral environment recognition 
means and a traveling condition output means. 

[0044]According to the invention according to claim 16, image data obtained from an 
output of one camera picturizes an omnidirection. Surrounding environment 
recognition of vehicles is performed using this image data. For this reason, in spite of 
an obstacle's having fallen on the side of vehicles or locating in it the other car which 
approaches from rear side of vehicles, when it is going to change lanes, traveling 
control which is not made to change lanes is performed according to these recognition 
results. Thereby, front and rear, right and left of vehicles can be supervised with one 
camera, and a safety operation of a driver can be supported. 

[0045]In addition to composition of the invention according to claim 16, a traveling 
control means is connected to a peripheral environment recognition means and a 
traveling condition output means, and the invention according to claim 1 7 contains a 
brake control means which controls a brake according to an output of a peripheral 
environment recognition means and a traveling condition output means. 
[0046]Image data from which the invention according to claim 1 7 is obtained from an 
output of one camera in addition to an operation of the invention according to claim 16 
and an effect picturizes an omnidirection. Surrounding environment recognition of 
vehicles is performed using this image data. For this reason, according to these 
recognition results, in spite of an obstacle's having fallen on the side of vehicles or 
locating in it the other car which approaches from rear side of vehicles, when it is 
going to change lanes, brake control is performed so that lanes may not be made to 
change. Thereby, front and rear, right and left of vehicles can be supervised with one 
camera, and a safety operation of a driver can be supported. 

[0047]In addition to composition of the invention according to claim 16, a traveling 
control means is connected to a peripheral environment recognition means and a 
traveling condition output means, and the invention according to claim 18 contains a 
steering control means which controls a steering according to an output of a 
peripheral environment recognition means and a traveling condition output means. 
[0048]Image data from which the invention according to claim 18 is obtained from an 
output of one camera in addition to an operation of the invention according to claim 16 
and an effect picturizes an omnidirection. Surrounding environment recognition of 



vehicles is performed using this image data. For this reason, according to these 
recognition results, in spite of an obstacle's having fallen on the side of vehicles or 
locating in it the other car which approaches from rear side of vehicles, when it is 
going to change lanes, steering control is performed so that lanes may not be made to 
change. Thereby, front and rear, right and left of vehicles can be supervised with one 
camera, and a safety operation of a driver can be supported. 

[0049]In addition to composition of the invention according to any one of claims 15 to 

18, it is connected to a peripheral environment recognition means and a traveling 
condition output means, and the invention according to claim 19 contains further a 
recorder which records an output of a peripheral environment recognition means and 
a traveling condition output means. 

[0050]An image from which the invention according to claim 19 is obtained from an 
output of one camera in addition to an operation of the invention according to any one 
of claims 15 to 18 and an effect picturizes an omnidirection. This image is recorded 
together with speed of vehicles, etc. For this reason, when an accident etc. happen, an 
accident cause can be correctly studied by analyzing an image, vehicles speed, etc. 
which were recorded on a recorder. 

[0051]In addition to composition of the invention according to any one of claims 7 to 

19, a condensing means is arranged at a position which has a camera and a 
predetermined relation, and the invention according to claim 20 contains a mirror 
which makes the convex side of a solid of revolution a mirror plane. 

[0052]In addition to composition of the invention according to claim 20, a mirror of the 
invention according to claim 21 is a hyperboloid mirror. 

[0053]In addition to composition of the invention according to any one of claims 7 to 
19, the invention according to claim 22 contains a fish-eye lens with which it has been 
arranged at a position which has a relation a camera and predetermined in a 
condensing means. 

[0054]Anti-theft system concerning the invention according to claim 23 is provided 

with the following. 

One camera ****(ed) by vehicles. 

A condensing means which is arranged at a position which has a camera and a 
predetermined relation, and condenses an image of an omnidirection to a camera. 
A suspicious person decision means which judges whether it is connected to a camera 
and a suspicious person is near the vehicles. 

An entrainment decision means which judges whether there are those who were 
connected to a camera and have taken vehicles, A physical action decision means 
which judges whether a physical action is added to vehicles, An alarm judging means 
which judges whether it is connected to a suspicious person decision means, an 
entrainment decision means, and a physical action decision means, and an alarm is 
outputted according to an output of a suspicious person decision means, an 



entrainment decision means, and a physical action decision means, An alarm 
outputting means which is connected to an alarm judging means and outputs a 
predetermined alarm according to an output of an alarm judging means. 

[0055]According to the invention according to claim 23, an image acquired from an 
output of one camera picturizes an omnidirection. An alarm is outputted, when 
judgment whether a suspicious person is based on this image is performed, people are 
not on vehicles, and a suspicious person sways vehicles or is ****(ing) a physical 
action, such as removing locking, to vehicles. Thereby, a theft by a suspicious person 
can be prevented. 

[0056]In addition to composition of the invention according to claim 23, the invention 
according to claim 24 includes a vehicle vibration decision means a physical action 
decision means judges it to be whether vibration is added to vehicles. 
[0057]In addition to composition of the invention according to claim 23, the invention 
according to claim 25 includes a locked state decision means a physical action 
decision means judges a locked state of vehicles to be. 

[0058]In addition to composition of the invention according to any one of claims 23 to 
25, it is connected to a camera and the invention according to claim 26 contains 
further a recorder which records an image. 

[0059]An image on which the invention according to claim 26 picturized an 
omnidirection in addition to an operation of the invention according to any one of 
claims 23 to 25 and an effect is recorded on a recorder. For this reason, when a theft 
etc. happen, by reproducing an image recorded on a recorder, an image to which a 
suspicious person was reflected can be acquired and a suspicious person can be 
specified. 

[0060]In addition to composition of the invention according to claim 26, a recorder is 
connected to a camera and a suspicious person decision means, and the invention 
according to claim 27 contains a device which records an output of an image and a 
suspicious person decision means. 

[0061 ]The invention according to claim 27 is recorded together with an image on 
which an output of a suspicious person decision means picturized an omnidirection in 
addition to an operation of the invention according to claim 26, and an effect. For this 
reason, an image to which a person who seems to be a suspicious person is reflected 
can be discovered easily, and a suspicious person can be specified more easily. 
[0062]In addition to composition of the invention according to claim 26, a recorder is 
connected to a camera and a physical action decision means, and the invention 
according to claim 28 contains a device which records an output of an image and a 
physical action decision means. 

[0063]The invention according to claim 28 is recorded together with an image on 
which an output of a physical action decision means picturized an omnidirection in 



addition to an operation of the invention according to claim 26, and an effect. For this 
reason, an image in a case of ****(ing) a physical action, such as swaying vehicles or 
removing locking, to vehicles can be discovered easily, and a suspicious person can be 
specified more easily. 

[0064]The invention according to claim 29 in composition of the invention according 
to claim 26 in addition, a recorder, It is connected to a camera, a suspicious person 
decision means, an entrainment decision means, a physical action decision means, and 
an alarm judging means, and a device which records an output of an image and a 
suspicious person decision means, an entrainment decision means, a physical action 
decision means, and an alarm Judging means is included. 

[0065]The invention according to claim 29 is recorded together with an image on 
which an output of a suspicious person decision means, an entrainment decision 
means, a physical action decision means, and an alarm judging means picturized an 
omnidirection in addition to an operation of the invention according to claim 26, and an 
effect. For this reason, a theft can be performed, an image when an alarm is emitted 
can be discovered easily, and a suspicious person can be specified more easily. 
[0066]In addition to composition of the invention according to any one of claims 23 to 
29, a condensing means is arranged at a position which has a camera and a 
predetermined relation, and the invention according to claim 30 contains a mirror 
which makes the convex side of a solid of revolution a mirror plane. 
[0067]In addition to composition of the invention according to claim 30, a mirror of the 
invention according to claim 31 is a hyperboloid mirror. 

[0068]In addition to composition of the invention according to any one of claims 23 to 
29, the invention according to claim 32 contains a fish-eye lens with which it has been 
arranged at a position which has a relation a camera and predetermined in a 
condensing means. 
[0069] 

[Embodiment of the Invention] [Embodiment 1] The drive recorder concerning the 
embodiment of the invention 1 is explained hereafter, referring to drawings. 
[0070] [Omnidirection visual sensor] The safety operation supporting system 
concerning this embodiment is a system which used the omnidirection visual sensor. 
With reference to drawing 1 , the composition of various kinds of omnidirection visual 
sensors is described. 

[0071](1) With reference to omnidirection visual-sensor drawing 1 (A) using a 
surface-of-a-sphere mirror, the omnidirection visual sensor using a 
surface-of-a-sphere mirror comprises the mirror 2 of a hemispherical surface 
installed downward [ perpendicular ], and the camera 4 installed in perpendicular 
facing up. In this sensor, the field area of a lower part hemisphere can be picturized at 
once. In order that this sensor may not receive astigmatic influence, there is the 
feature of being easy to carry out the design of an optical system. About the 



omnidirection visual sensor using a surface-of-a-sphere mirror, "J. Hong, X.Tan, 
B.Pinette, R.Weiss, and E.M.Riseman: "Image-based homing", Proc.Int. Conf. Robotics 
and Automation IEEE, pp. It is indicated in detail by 620-625 (1991)" etc. 
[0072](2) The omnidirection visual sensor (COPIS) using a conical mirror 
Omnidirection visual-sensor COPIS (Conic Projection Image Sensor) using a conical 
mirror was proposed by Yagi and others. With reference to drawing 1 (B), COPIS 
comprises the mirror 6 of a cone form installed downward [ perpendicular ], and the 
camera 4 installed in perpendicular facing up. The picture acquired by COPIS is a 
picture which picturized the omnidirection centering on the side. COPIS has the 
feature that the vertical edge in environment is stably detectable. In COPIS, the 
vertical edge in environment is projected radiately. Correctly, although this feature is 
being able to say all the omnidirection vision, in COPIS which makes especially the 
side a central visual field, vertical edge is projected for a long time. For this reason, 
vertical edge is stably detectable. About omnidirection visual-sensor COPIS, "Y.Yagi, 
Y.Nisizawa and M.Yachida: "Map-based navigation for a mobile robot with 
omnidirectional image sensor COPIS",Trans. . It is indicated in detail by on Robotics 
and Automation, 11 and 5, pp.638-648 (1995)", etc. 

[0073](3) The omnidirection visual sensor using a hyperboloid mirror (HyperOmni 
Vision) 

Omnidirection visual-sensor HyperOmni Vision using a hyperboloid mirror was 
proposed by Yamazawa and others. With reference to drawing 1 (C), HyperOmni Vision 
comprises the hyperboloid mirror 8 installed downward [ perpendicular ] and the 
camera 4 made into perpendicular facing up. 

[0074]With reference to drawing 2 , the hyperboloid in the field of [ Z> 0 ] the 2 leaf 
hyperboloids is used for the hyperboloid mirror 8 as a mirror. 2 leaf hyperboloid is a 
curved surface acquired by rotating a hyperbola to the circumference of a real axis 
(Z-axis). 2 leaf hyperboloid has two foci of (0. 0, +c), and (0, 0, -c). It corrects, [0075] 
[Equation 1] 

[0076]It comes out. Here, three-dimensional coordinate system O-XYZ which makes 
the Z-axis a vertical axis as shown in drawing 2 is considered. 2 leaf hyperboloid is 
expressed with the following formulas (1) at this time. 
[0077] 
[Equation 2] 

[0078]The constants a and b define the shape of a hyperbola. With reference to 
drawing 3 , omnidirection visual-sensor HyperOmni Vision comprises the hyperboloid 



mirror 8 in the field of Z> 0 installed downward [ perpendicular ], and a camera (not 
shown) installed in the bottom of it at perpendicular facing up. At this time, the 
hyperboloid mirror 8 and a camera are arranged so that focal OM of the mirror 8 and 
lens center OC of a camera may be located in two foci (0, 0, +c) of 2 leaf hyperboloid, 
and (0, 0, ~c), respectively. The image face xy is parallel to an XY plane, and is made 
into the flat surface which separated only the focal distance f of the camera from lens 
center OC of the camera. The reflector of the mirror 8, focal OM of the mirror 8, and 
lens center OC of a camera are expressed with the following formulas (2). 
[0079] 
[Equation 3] 

a^^ffi ^l^-f;--i(z>o) 

. CO^S^&OM (OA+c) (2) 



[0080]When the mapping point on the picture over the arbitrary points P in space (X, Y, 
Z) is set to p (x. y) with reference to drawing 4 , the angle of direction theta of the 
point P is expressed with the following formulas (3). 
[0081] 

tan theta=Y/X=y/x (3) 

That is, the angle of direction theta of the point P defined by Y/X is acquired by 
computing the angle of direction theta of the mapping point p defined by y/x. Thus, 
the angle of direction theta of the object body in a 360-degree panorama-like field 
appears directly as a direction of the map on the image face of the object. 
[0082]If the perpendicular section containing the point P and the Z-axis is assumed 
with reference to drawing 5 , the relation of the following formulas (4) will be realized 
between the point P and the mapping point p. 
[0083] 
[Equation 4] 



[0084]That is, the angle of direction theta and the angle of depression alpha of the 
point P from focal OM of the mirror 8 are providing lens center OC of a camera in the 
focal position of a hyperboloid, and a meaning is asked for them from the mapping 
point p (x, y). Since focal OM of the mirror 8 is being fixed at this time, it is convertible 
for the picture acquired by rotating the camera which saw the inputted image from 



focal OM of the mirror 8 to the circumference of a vertical axis, or the picture of the 
usual camera. 

[0085]About omnidirection visual-sensor HyperOmni Vision, " — Yamazawa — 
Kazumasa — others — : — " — a mobile robot — navigation — a sake — an 
omnidirection — a visual sensor — " — the Institute of Electronics, Information and 
Communication Engineers — a paper — a magazine — D-IIVol . — J — 79 - D-IINo . 
— five — pp . — 698 - 707 (May, 1996) — " — etc. — detailed — indicating — 
having — **** . 

[0086](4) The omnidirection visual sensor using other omnidirection visual sensors, 
others, and a paraboloid mirror, the omnidirection visual sensor using a compound 
mirror, etc. are proposed. About the omnidirection visual sensor using a paraboloid 
mirror, "V.Peri and S.K.Nayar: "Omnidirectional Video System", Proc.U.S-Japan 
Graduate Student Forum in Robotics,PP.28-31(1996) It is alike and is indicated in 
detail. About the omnidirection visual sensor using a compound mirror, it is indicated 
in detail by "research [ of :" reflection type wide angle optical system besides **** 
SICE, 102A_3, pp.59-60 (1994)." 

[0087][Drive recorder] With reference to drawing 6 , a drive recorder contains 
omnidirection visual-sensor HyperOmni Vision12 installed so that a method of the 
vehicles 14 order, the side, and the driver 16 could be observed. HyperOmni Vision12 
is provided with the following. 

As mentioned above, the hyperboloid mirror 8 installed downward [ perpendicular ]. 
The camera 4 which carried out a medial axis and an optical axis of the hyperboloid 
mirror 8 in common, and was installed in perpendicular facing up. 

[0088]The A/D (Analog to Digital) converter 40 with which a drive recorder receives 
an analog output of the camera 4 with reference to drawing 7 , The monitor 48 which 
displays an image which is connected to A/D converter 40 and outputted from the 
camera 4, It is connected to A/D converter 40, and an image outputted from the 
camera 4 via A/D converter 40 is received, and the vehicle speed, a braking state, a 
yaw rate, acceleration, a steering state, etc. of the vehicles 14 are received, and the 
recorder 42 which records those information with the above-mentioned image is 
included further. 

[0089]With reference to drawing 8 , a method of the vehicles 14 order and right and left 
are projected on an image picturized with the camera 4. For example, the lanes 33 and 
34 of the front and back, the sign 18, the driver 16, etc. are projected. 
[0090]This image is displayed on the monitor 48 every moment. For this reason, the 
driver 16 can perform simultaneously surveillance of not only the front but back and 
the side. For this reason, an accident etc. can be prevented and the driver 1 6 can be 
operated safely. 

[0091] An above-mentioned image is recorded on the recorder 42 every moment with 



the vehicle speed, a braking state, a yaw rate, acceleration, and a steering state of the 
vehicles 14. For this reason, by analyzing an image recorded on the recorder 42, and 
various states of the vehicles 14, when an accident should happen, Since the driver 16 
was dozing off while driving, an accident cause in which an accident happened, like 
other vehicles have clashed from behind from the side, or the vehicles 14 gather 
speed too much can be studied correctly. 

[0092]What is necessary is just to change an installed position of HyperOmni Vision12 
behind the vehicles 14 to secure a back field of view from a situation of the driver 16. 
and use for a safety operation with reference to drawing 9 . Thereby, as shown in 
drawing 10 , surveillance behind the vehicles 1 4 becomes easier and a safety operation 
can be supported. 

[0093]With reference to drawing 11 , a drive recorder. The monitor 49 connected to 
the camera 4 contained in HyperOmni Vision 12 and HyperOmni Vision 12. It may be 
the composition containing the recorder 44 which receives an image outputted from 
the camera 4, and receives the vehicle speed, a braking state, a yaw rate, acceleration, 
a steering state, etc. of the vehicles 14. and records those information with an image. 
That is. without changing an output of the camera 4 into a digital signal unlike a drive 
recorder explained with reference to drawing 7 , it can display on the monitor 49 with 
an analog signal, or can record on the recorder 44 with an analog signal. 
[0094][Embodiment 2] With reference to drawing 12 , a safety operation supporting 
system concerning the embodiment of the invention 2 is provided with the following. 
HyperOmni Vision12. 

A/D converter 40 which is connected to the camera 4 contained in HyperOmni 
Vision 12, and receives an analog output of the camera 4. 

The image processing portion 50 which changes into an image without distortion an 
image of an omnidirection which was connected to A/D converter 40 and picturized 
with the camera 4. 

The monitor 48 which displays an image which is connected to the image processing 
portion 50 and does not have distortion. The recorder 42 which is connected to the 
image processing portion 50. and receives an image without distortion, and receives 
the vehicle speed, a braking state, a yaw rate, acceleration, a steering state, etc. of 
the vehicles 14, and records those information with an image without distortion. 

[0095]Since HyperOmni Vision12 is the same as that of what was explained by 
Embodiment 1, explanation is not repeated. 

[0096]Since an installed position of HyperOmni Vision12 is the same as an installed 
position of HyperOmni Vision12 of a drive recorder explained with reference to 
drawing 9 , explanation is not repeated. For this reason, an image picturized with the 
camera 4 is an image as shown in drawing 10 . 

[0097]The image processing portion 50 changes into an image as shown in drawing 1 3 



an image shown in drawing 10 in accordance with a method in which it was provided 
beforehand. That is, an image of drawing 13 is image same with having rotated a 
camera 360 degrees horizontally centering on the vehicles 14, and having picturized. 
An image shown in drawing 13 is what expressed an image of a method of left-hand 
side of the vehicles 14, the front, a method of right-hand side, and back in a form 
without distortion as it goes to right-hand side from left-hand side. 
[0098]An image without such distortion is displayed on the monitor 48 every moment. 
For this reason, the driver 16 can supervise the circumference of the vehicles 14 at 
once. And since an image without distortion is displayed on the monitor 48, the 
surrounding situation can be recognized more nearly promptly, an accident etc. can be 
prevented beforehand, and the driver 1 6 can be operated safely. 
[0099]An image without distortion of **** is recorded on the recorder 42 every 
moment with the vehicle speed, a braking state, a yaw rate, acceleration, and a 
steering state of the vehicles 14. For this reason, when an accident should happen, by 
analyzing an image recorded on the recorder 42, and various states of the vehicles 14, 
other vehicles have clashed from behind from the side, or an accident cause, like the 
vehicles 14 gather speed too much can be studied correctly. And since an image 
without distortion is recorded, investigation of an accident cause can be performed 
still more correctly and easily. 

[0100][Embodiment 3] With reference to drawing 14 , a safety operation supporting 
system concerning the embodiment of the invention 3 is provided with the following. 
HyperOmni Vision12. 

A/D converter 40 which is connected to the camera 4 contained in HyperOmni 
Vision 12, and receives an analog output of the camera 4. 

The image processing portion 22 for recognizing the sign 18 ( drawing 6 ) which is 
connected to A/D converter 40. processes image data of digital data, and is located 
ahead of the vehicles 14. or recognizing a state of the driver 16. 
It is connected to the loudspeaker 26 and an output of the image processing portion 
22. and a state of the vehicle speed, a brake, and a steering is received. The running 
control part 24 for taking out an alarm from the loudspeaker 26. when the vehicles 14 
are carrying out abnormal traveling, or when the driver 16 is dozing, or performing 
control of a brake and a steering. 

[0101]Since HyperOmni Vision12 is the same as that of what was explained by 
Embodiment 1, explanation is not repeated. 

[0102]Since an installed position of HyperOmni Vision12 is the same as an installed 
position of HyperOmni Vision12 of a drive recorder explained with reference to 
drawing 6 , explanation is not repeated. For this reason, an image picturized with the 
camera 4 is an image as shown in drawing 8 . 

[0103]With reference to drawing 8 and drawing 15 , the image processing portion 22 



( drawing 14 ) operates as follows. 

[0104]The image processing portion 22 receives the image data 32 ( drawing 8 ) 
outputted from the camera 4, and recognizes a forward area of the vehicles 14 (S2 of 
drawing 1 5 ). This processing detects the lane 33 and the sign 18 from the image data 
32 using the existing image processings technique, such as pattern matching. 
[0105]It is judged whether the vehicles 14 shift from the lane 33 and the image 
processing portion 22 is running (S4). When it is judged that the vehicles 14 shift from 
the lane 33 and are running, YES) and the image processing portion 22 output a signal 
which shows that the vehicles 14 have shifted from the lane 33, and the amount of 
gaps from the lane 33 as an adjustment signal by (S4 (S6). 

[01 06] After outputting an adjustment signal when it is Judged that the vehicles 14 
have not shifted from the lane 33 (it is NO at S4) or (S6), it is Judged whether the 
image processing portion 22 detected the sign 18 to a forward area (S8). When it is 
Judged that the sign 18 is detected, by (S8. a kind of YES) and its sign 18 is recognized 
and it outputs as a sign recognition signal. 

[0107]When it is Judged that the sign 18 is not detected (it is NO at S8), or after 
outputting a sign recognition signal (S10), an image processing portion recognizes 
indoor environment of the vehicles 14. It is recognized whether using the existing 
image processings technique, such as pattern matching, this detects a position of an 
eye of the driver 16 and eyes are opening it (SI 2). 

[0108]It is judged whether beyond in predetermined time, an eye of whether the driver 
1 6 is dozing and the driver 1 6 has closed the image processing portion 22 (SI 4). When 
it is judged that the driver 16 is dozing, YES) and the image processing portion 22 
output a nap signal showing the driver 16 dozing by (SI 4. 

[0109]When it is judged that the driver 16 has not dozed (it is NO at SI 4), or after 
outputting a nap signal (SI 6), the image processing portion 22 repeats processing 
after S2 again. 

[01 10]With reference to drawing 16 , the running control part 24 ( drawing 14 ) operates 
as follows. It is judged whether the running control part 24 has received an adjustment 
signal from the image processing portion 22 (S22). If an adjustment signal is received 
(it is YES at S22), the running control part 24 will operate a steering based on the 
amount of gaps contained in an adjustment signal so that the vehicles 14 may run the 
inside of the lane 33 (S24). 

[01 1 1] After performing steering operation when it is Judged that an adjustment signal 
is not received (it is NO at S22) or (S24), it is judged whether the running control part 
24 has received a sign recognition signal (S26). If a sign recognition signal is received 
(it is YES at S26), the running control part 24 will operate a brake or a steering 
according to a kind of sign 18 (S28). For example, if the sign 18 is the sign 18 of a 
speed limit which is 50 km/h and a travel speed of the vehicles 14 is larger than it, a 
running control part, By operating a brake, a throttle (accelerator), or transmission, 



speed control is performed so that a travel speed of the vehicles 14 may be 50 km/h 
or less. 

[01 1 2] After performing operation of a brake or a steering when it is judged that a sign 
recognition signal is not received (it is NO at S26) or (S28), it is judged whether the 
running control part 24 has received a nap signal (S30). When it is judged that a nap 
signal is received, by (S30, from the loudspeaker 26, YES) and the running control part 
24 output an alarm, and urge cautions to the driver 16. 

[0113]When it is judged that a nap signal is not received (it is NO at S30), or after 
outputting an alarm (S32X the running control part 24 repeats processing after S22. 
[01 14] Although the running control part 24 performed operation of a brake and a 
steering in the above-mentioned explanation, it cannot be overemphasized that these 
operations are not performed but it may be made to output only an alarm from a 
position which supports operation of the driver 1 6. 

[0115]With the above safety operation supporting systems, the one camera 4 can 
perform state recognition of the driver 16. and front surveillance of the vehicles 14, 
and a safety operation of the driver 16 can be supported. 

[01 16][Embodiment 4] With reference to drawing 17 , a safety operation supporting 
system concerning the embodiment of the invention 4 is provided with the following. 
HyperOmni Vision12. 

A/D converter 40 which is connected to the camera 4 contained in HyperOmni 
Vision12, and receives an analog output of the camera 4. 

The image processing portion 52 for recognizing an obstacle which is connected to 
A/D converter 40, processes image data of digital data, and is located in back and the 
side of vehicles. 

It is connected to the loudspeaker 26 and an output of the image processing portion 
52, receive the vehicle speed, a braking state, a yaw rate, acceleration, a steering 
state, etc. of vehicles, and changing lanes in spite of a dangerous state, The running 
control part 56 which takes out an alarm from the loudspeaker 26 when vehicles are 
going to change lanes, or performs control of a brake and a steering, The recorder 43 
which records the vehicle speed, a braking state, a yaw rate, acceleration, a steering 
state, etc. of vehicles every moment with a recognition result of an image which was 
connected to A/D converter 40 and the image processing portion 52, and was 
picturized with the camera 4, and an obstacle outputted from the image processing 
portion 52. 

[0117]Since HyperOmni Vision12 is the same as that of what was explained by 
Embodiment 1, explanation is not repeated. 

[0118]Since an installed position of HyperOmni Vision12 is the same as an installed 
position of HyperOmni Vision 12 of a drive recorder explained with reference to 
drawing 9 . explanation is not repeated. For this reason, an image picturized with the 



camera 4 is an image as shown in drawing 1 0 . 

[01 1 9]With reference to drawing 1 8 , each part of a safety operation supporting system 
operates as follows. Inside of an image ( drawing 10 ) from which the image processing 
portion 52 was incorporated from HyperOmni Vision12 via A/D converter 40, The 
image recognition of the image of back and the side is carried out, and when there are 
obstacles, such as other vehicles close to back or the side, a signal showing a signal 
(henceforth "an obstacle detection signal") which shows that there is an obstacle, 
and its position is outputted (S42). It is judged whether the running control part 56 
received an obstacle detection signal from the image processing portion 52 (S44). 
When an obstacle detection signal is not received. NO) and an alarm output from the 
loudspeaker 26 are not performed by (S44 (S50), but it returns to S42. 
[0120]When an obstacle detection signal is received, YES) and the running control 
part 56 judge whether the driver 16 is try to change lanes in the direction with an 
obstacle from a state of a turn signal of the vehicles 14, and a state of a steering by 
(S44 (S46). In not trying to change lanes in the direction in which an obstacle has the 
driver 16, it does not perform NO) and an alarm output from the loudspeaker 26 by 
(S46 (S50), but it returns to S42. 

[0121]The driver 16 is told about it being dangerous to perform an alarm output from 
YES) and the loudspeaker 26 by (S46, when the driver 16 is trying to change lanes in 
the direction with an obstacle (S48), and to perform the present lane change. 
[0122]When the driver 16 continues a rectilinear-propagation run, without operating a 
steering, it returns to NO) and S42 by (S52. In spite of having performed an alarm 
output to the driver 16, when the driver 16 tries to change lanes by operating a 
steering, by (S52 YES) and the running control part 56, In order to avoid a collision to 
an obstacle, the automatic control of a brake and a steering of the vehicles 14 is 
carried out (S54). Then, it returns to S42. 

[0123]As mentioned above, in a safety operation supporting system concerning this 
embodiment. There are other vehicles close to rear side of vehicles, or although an 
obstacle has fallen on the side, when it is going to change lanes, an alarm output is 
performed so that lanes may not be made to change, or control of a brake, a steering, 
etc. is performed. A collision in case this is trying to perform a lane change with the 
impossible driver 16 can be avoided, and a safety operation of the driver 16 can be 
supported. 

[01 24] Although the running control part 56 performed operation of a brake and a 
steering in the above-mentioned explanation, it cannot be overemphasized that these 
operations are not performed but it may be made to output only an alarm from a 
position which supports operation of the driver 1 6. 

[0125]An image outputted from above-mentioned HyperOmni Vision12 is recorded on 
the recorder 43 every moment with a recognition result of an obstacle in the image 
processing portions 52, such as the vehicle speed, a braking state, a yaw rate, 



acceleration, a steering state, etc. of the vehicles 14. For this reason, by analyzing 
existence of an innage recorded on the recorder 43, various states of the vehicles 14, 
and an obstacle of the vehicles 14 circumference, when an accident should happen, 
Since the driver 16 tried to do an impossible lane change, an accident cause of an 
accident having happened can be studied correctly. 

[0126][Embodiment 5] With reference to drawing 19 . anti-theft system concerning the 
embodiment of the invention 5 is provided with the following. 
HyperOmni Vision12. 

A/D converter 40 which is connected to the camera 4 contained in HyperOmni 
Vision12, and receives an analog output of the camera 4. 

The image processing portion 54 which is connected to A/D converter 40, processes 
image data of digital data, and recognizes a crew member in vehicles, and a suspicious 
person besides vehicles. 

While being connected to the loudspeaker 26 and an output of the image processing 
portion 54 and receiving a recognition result of the image processing portion 54. When 
it receives from a device which does not illustrate an oscillating situation of the body, 
a locked state of the body, etc. and people are not on vehicles, The alarm 
determination device 58 which outputs an alarm from the loudspeaker 26 when a 
suspicious person sways vehicles or is ****(ing) a physical action, such as removing 
locking, to vehicles, A/D converter 40, the image processing portion 54, and the 
recorder 46 that is connected alarm determination device 58 and records each output 
every moment with an oscillating situation of the above-mentioned body, and a locked 
state of the body. 

[0127]Since HyperOmni Vision12 is the same as that of what was explained by 
Embodiment 1. explanation is not repeated. 

[0128]HyperOmni Vision12 is installed in a position which can picturize a situation 
outside a vehicle occupant and a car. 

[0129]With reference to drawing 20 , each part of an antitheft device operates as 
follows. From an image outputted from HyperOmni Vision 12, the image processing 
portion 54 recognizes a crew member in vehicles, and a suspicious person besides 
vehicles, and outputs the result (S62). The alarm determination device 58 receives a 
recognition result from the image processing portion 54, and people do not ride on 
vehicles, When a suspicious person is near the vehicles, and vibration is added to the 
body or locking is canceled, YES and S70 perform an alarm output from YES) and the 
loudspeaker 26 by (S66 NO and S68 (S72). Then, it returns to S64. When people are 
on vehicles (it is YES at S66) and a suspicious person is not in the neighborhood (it is 
NO at S68), or when vibration does not add to the body and locking is not canceled (it 
is NO at S70), the alarm determination device 58 does not perform an alarm output 
from the loudspeaker 26 (S74). Then, it returns to S64. 



[0130]When according to anti-theft system applied to this embodiment as mentioned 
above judgment whether a situation of the inside and outside of vehicles is picturized, 
and a suspicious person is based on a picturized image with one camera is performed 
and people are not on vehicles, An alarm is outputted, when a suspicious person 
sways vehicles or is ****(ing) a physical action, such as removing locking, to vehicles. 
Thereby, a theft by a suspicious person can be prevented. 

[0131]An image outputted from above-mentioned HyperOmni Vision12 is recorded on 
the recorder 46 every moment with an output of the image processing portion 54, an 
output of the alarm determination device 58 and vibration of the body, a locked state, 
etc. For this reason, when a theft should happen, a suspicious person can be specified 
based on information recorded on the recorder 46. 

[0132]Although HyperOmni Vision was used as an omnidirection visual sensor in 
anti-theft system concerning a safety operation supporting system and Embodiment 5 
concerning a drive recorder concerning Embodiment 1 mentioned above, and 
Embodiments 2-4, Same effect is acquired even if it uses an omnidirection visual 
sensor using an above-mentioned surface-of-a-sphere mirror, an omnidirection visual 
sensor (COPIS) using a conical mirror, an omnidirection visual sensor using a 
paraboloid mirror, or an omnidirection visual sensor using a compound mirror. 
[0133]Composition which attaches a fish-eye lens may be used for a front face of the 
camera 4 instead of using the hyperboloid mirror 8. Instead of using the hyperboloid 
mirror 8, the camera 4 may be rotated and composition which captures an image of an 
omnidirection may be used. 

[0134]Thus, in anti-theft system concerning a safety operation supporting system and 
Embodiment 5 concerning a drive recorder concerning Embodiment 1, and 
Embodiments 2-4, a picture of an omnidirection can be synchronously acquired using 
one camera. For this reason, a system outstanding also in cost and structurally is 
realizable. 

[0135]With all the points, an embodiment indicated this time is illustration and should 
be considered not to be restrictive. The range of this invention is shown by 
above-mentioned not explanation but claim, and it is meant that a claim, an equivalent 
meaning, and all the change in within the limits are included. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a figure showing the composition of various kinds of omnidirection 
visual sensors. 

[Drawing 2] It is a figure explaining 2 leaf hyperboloid. 



[Drawing 3] lt is a figure showing the composition of omnidirection visual-sensor 
HyperOmni Vision. 

[Drawing 4] It is Drawing 1 explaining the relation between the arbitrary points in space, 
and the mapping point on a picture. 

[Drawing 5] lt is Drawing 2 explaining the relation between the arbitrary points in space, 
and the mapping point on a picture. 

[Drawing 6] It is an outline view of the drive recorder concerning the embodiment of 
the invention 1. 

[Drawing 7] It is a figure showing the composition of the drive recorder concerning the 
embodiment of the invention 1. 

[Drawing 8] It is a figure showing an example of the picture picturized by omnidirection 
visual-sensor HyperOmni Vision. 

[Drawing 9] It is an outline view of the drive recorder which changed the installed 
position of omnidirection visual-sensor HyperOmni Vision. 

[Drawing 10] It is a figure showing an example of the picture picturized by 
omnidirection visual-sensor HyperOmni Vision which changed the installed position. 
[Drawing 1 1] It is a figure showing the composition of others of a drive recorder. 
[Drawing 12] It is a figure showing the composition of the safety operation supporting 
system concerning the embodiment of the invention 2. 

[Drawing 13] It is a figure showing an example of a picture which changed the picture 
shown in drawing 10 so that there might be no distortion. 

[Drawing 14] It is a figure showing the composition of the safety operation supporting 
system concerning the embodiment of the invention 3. 

[Drawing 15] It is a flow chart of the processing performed by the image processing 
portion 22. 

[Drawing 16] It is a flow chart of the processing performed by the running control part 
24. 

[Drawing 1 7] It is a figure showing the composition of the safety operation supporting 
system concerning the embodiment of the invention 4. 

[Drawing 18] It is a flow chart of the processing performed with a safety operation 
supporting system. 

[Drawing 19] It is a figure showing the composition of the anti-theft system concerning 
the embodiment of the invention 5. 

[Drawing 20] It is a flow chart of the processing performed with anti-theft system. 
[Drawing 21] It is an outline view of the conventional safety operation supporting 
system. 

[Description of Notations] 
4 Camera 

8 Hyperboloid mirror 

12 Omnidirection visual-sensor HyperOmni Vision 



40 A/D converter 
42 Recorder 
48 Monitor 
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ioXXS (0, 0, -c) tcfifl-r^J:'9tc^fflffi^'^- 
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s (2) rmt^^n^o 

[0 0 7 9] 



15 



(9) 



* 

(OA+c) 



. -l(Z > 0) 



200 0-128031 



16 



(2) 



[0 0 8 0] llI4^#0eLT. ^PaWoeictOiiSP 

(X. Y. z) iznr^mm±v(D'wm}^^p (x. 

y) ^L/cBt. ^^spo^fift etii-^^Tco^ (3) rmt>^io 

t a n 0 = YXX-y/x 



Zm4X 

a- tan 



* tana+c 
J 

.2 . „2 



[008 1] 

(3) 

* [0 0 8 2] Src. 0 5^#S§bT. .'^.P^Zitt^*^ 

t:>(Tc>i\: (4) (Dmm'^j&±-:>o 

[0 0 8 3] 
[8!(4] 



(4) 



[0 0 8 4] ^r^t:^^^'y—S(D^MOUt^^(D]^.P(D 
ffiffitO^/iSfiiatCl^tt^cl^T. ^ft;Sp (x, y) ^ 
Il^^nTV^^/ci6. A^®ft^^^-8iO^..-^OM;6^ 

[0 0 8 5] ^7?ffi^I^-fe>1^Hyper0nini VisiontcflL 30 

D-IIVol, J79-D-IINO. 5pp. 69 
8-707 (1996^5.^) J ^^tC|¥L < T^^^n 

[0 0 8 6] ( 4 ) ^(o^m^-nmrn"^ v-y- 

rv.Peri and S.K.Nayar: "Omnidirectional Video 40 
System", Proc. U. S-Japan Graduate Student Forum in 
Robotics, PP. 28-31(1996) J < r?^^^nTV> 

rVrmm : "S:St§y/Aft)t^^^OW^",SICE,102A _3,p 
p. 59-60 (1994) J tCl¥b<F^1^$nTV^^o 
[0 0 8 7] [F-^-f >^l/n-^lC0l>T] 06:^#Hg 

^7a{iL?I:l-try-y-Hyper0mni Visionl 2^#t5'o HyperO 
mni Visionl 2ti. ±ai«OJ:^tc. mKTfplttcSB^ 50 



[0 0 8 8] 0 7^#fi§LT. H^Yr^Un-^li, :^ 
^•5'4 0T'^n^7ii;^^Stt^A/D (Analog to Digi 

tai) m^mmAoh^ A/D^3^t^4 otcjg^^n. ti 

^^4 J:0m:^i^n^Mi^^^'r^^-^4 8^. A 

/D^i5^§§4 OtcSl^^tl. k/\)^mmAO^i\LX 

[0 0 8 9] ms^m^x^x. AxmLm-^ntz^ 

fttcti:. *i^l 4iDSuf^75-43j;tffe^:6^W^nTv^^o 

li1j7a*5i:mS7?^Omig3 3. 3 4. Si 
8, F^^^U 6«cH;?)'^K^nTV>;i)o 
[0 0 9 0] CCO0W^:6'^^>^glJ>^?^-^ 4 S^C^^^n 

[0 0 9 1] ^Tc. ±M(Dmmt. M^i 4tD*3S. 

s^nfcB*f^:ioi:t;mM 1 4 6oit^^mi^»w^^ci 
^tccfco. F^-r/u Qifmm.^mk^\yX\^^rcrc}t>\z 
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[0 0 9 2] 0 9:^#fIbT. Vy^ ^(T^AXU^^ 

ti. HyperOmni Vision 1 2 cQ^RfiH^JfXW 1 4(0^^0 
{c^MTntfJ:v\ cintc<i:0. 1 0 tc^f J: d tc. 

[0 0 9 3] S/c. 0 1 l^#ggbT. K^>ryUn- 
^li. HyperOmni Vision 1 2 HyperOmni Vision 1 2 

tC'g'^n^;^^v4tcg^^t^n/c^^^4 9h. 

^K4 4 i:^^01ij^cTfeoT^J;i/\ ^^t)-^. HIT 

{i^co*^^-:^4 9tcg^L/cD. r-^n^^a^OS 
StE®^a4 4tc|BilL/cD-r^ii^*^^T#^o 

[0 0 9 4] [::t-]5som^2] m 1 2:&#psbT. 

0JJ(7:>yiSa^omi2 tcf^^S^MK^Mi^Xx Ati. Hype 
rOmni Vision 1 2^. HyperOmni Vision 1 2lc#$n^ 
^><'^4(cSM^n. :^;^^4 0T*^n^'m;b^Stt^ 

A/D^1^t§4 0^. A/D^^§§4 OtC^l^^^n. :^ 

^B#5aagP5 0 wmmn^ otcsM^n. 

<^:^tCta^^^tSg^B4 2 }L^^t3o 
[0 0 9 5] HyperOmni Vision 1 2\t. ^M(DBBlT 

[0 0 9 6] $fc. HyperOmni Vision 1 ZCDt&MitS 
it. m9 L TiftB^ b H ^ :7V n - ^^^iOHyperO 

mni Vision 1 2(DmmiiLmtmm'v^^rcisb. mmit±m 

1 otc^^cfc^^wfii-^^^^o 

[ 0 0 9 7 ] m 1 0 tC^'r0*ft^iilft®?igf5 5 0 ti. ^ 

tLX. :^^^:&7j<TtC3 6 OSmls^-^iTilftL/cO 
^[pHtOWftr^^^o 01 3tC^t-B«tti:> J^mt^ib^ 

[0 0 9 8] C(D^o^ik^(Drj:\,^m^t^m^M^'e:=~ 
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[0 0 9 9] ^fc. ±aiOig^cO^O^05tf|lt^. 1 4 

a4 2 tcfaii^n/c0*{^*5j;rfmi^ 1 4 (om^r^-^m^ 
[0 10 0] mm(omm3] mi 4^#R§bT. 

0^t?^^SEtom^3tC{I^^^^Mte^ii>^XT-Ati. Hype 
rOmni Vision! 2t. HyperOmni Vision 1 ZK^^H^ 

ti^'y 4{cmm^n. ti^^^y 4(Dy-rt2^^ttit}^^if^ 
A/D^^m4ot. A/D^mmAoicmm^n. 9 

\^-ti 2 6 i:. mmmm^z 2<o^ti\^mm,^n. m 

^^mcy^V-^:foJ:t5XT-7U>^^^i?Dmi^§ 
tt. :^f^l 4jO^M'^^tT^brv>;|,iI^'^. F^-T/U 
6?b^g3S0^bTV^^^'&:^^HcXlf-:^2 6?b^6^^ 
^ffibfcO. :/U-4^*5J:t/Xf-TU>^'C>SiJffl^tf55: 
o/cD-r^rci6cD^ff$fW0f5 2 4 i:^#t5'o 
[0 10 1] HyperOmni Vision 1 2 ti. ^SSiOJfJfil 1 

[0 10 2] ^/c. HyperOmni Vision 1 2 tDlSgfuB 
it. EI6^#PILTt«0^b/c F^-r 3 -^^'(OHyperO 
mni Vision 1 2 cO^H{i«hIWHiTfe^/ci6. ifSR^ti^ 

3i^^t^ ccDtcisb^ :^^^4xmm'^rircmim±. m 
[0 10 3] Ei8:jo<^t>^ia 1 s^^mmLx. mmmm 

2 2 (014) if±\:AT(D^vlfCmi'^^^o 
[0 10 4] llifgjMg|52 2{i. ;^;^-^4 J;DtB^^n 
^lU3Ht'r-^3 2 (0 8) 4 0fliWfjai^ 

(oif^is^tf^^ (Ell 50S2) o ccommit. 

[0 10 5] mmwim^^z zit. mm 4ff^mm3 st^ 

^-rtix^'iiLxi^^f^^^fi^mmT^ (S4) o w 
1 4ti^mm3 3t)^^-frixmjLxi^^ tnmLrcm-^ 
{cit (S4TYES) . mmmmmzzit. mmi 4:6^ 
mM3 3t)'^^^nx\^^^ct^^^rm^t. mB33'h^ 
^^(D'fnmtmhMmiEimtLx&itir^ (se) o 
[0 10 6] mm AtiWms 3t^^'fnxi^rsi^tn 
50 iffL/c«'& (s4-eNo) . "^Tc^mMmiEm^^^ti 
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Lfcm (S6) . aft5[LagP2 2ti. myimm^cmmi 
ihLrh^^^tnwiLrcm^ici^t (ss-^yes) . ^(o 

[0 10 7] 8^1^tbbTl^^V^^|iJ»TLrc^'& 

(ssTNo) . ^mmimmm^^ibidLrcm (s 
10). mi^^mmt. mmi 4(Dm\HmmmiM^n 

l/^Tl/^^:^^S:^^Olf.ii^^f^^^^0T^fe^ (S 1 2) o 

[0 10 8] mmmm^z 2 it. f-^-t/^i e^^'^i^-tig'^ 

0#rBUX±P^UTl^^;^j^S:^^^WK^^ (S 1 4) o 
-Y/U 6;6^^iS0^LTt/>^^¥iJ©fb/cif'a'tCti: (S 1 
4TYES) . iiifS4a3EigP2 2ti. F^^>'U 6;6^gBg 

[0 10 9] Fv^/U 6;b^^giS0^Lri>^V>h¥iJ|^ 
Lfctf^ (s 1 4TN0) . S/c(igiBDfH^^m:/ab 

/eft (S 1 6) . l«J[liiilffP2 2(i. S 2mOj5aJl^ 20 

[0 1 1 0] H 1 6^#0§LT. >£tTfli'J®gP2 4 (0 1 
4) tii-::(T<?:>J:*5tcfft{t*r^o ^tTSyffliSI5 2 4 ti. lift 
fflagP2 2 J; D«liHtIEfS^^§ftLTl^^/)^§;b^^¥iJ 
(S 2 2) o IA}HifIE«^^S:faLTV^nif (S 
2 2TY E S) . ^tf»g|5 2 4ti. ttilf^IEif ^tC# 

nr^.^oicTsV'Tvy^^^mi'^r^ (S2 4) o 
[0 111] mMmjEm''j^^mLri>rj:i^tnmLrc 

if^ (S2 2'U^NO) . ^tzltXf-TVy^Mi'^^n^^ 30 
-:>rcm (S 2 4) . ^tTSWgf5 2 4fi. tlliE^.i^ff 
^fiLTl/^^:^)^Sjb^^W»TT^ (S2 6) o WMVEMm 
^^§lHbTl>ntf (S2 6-eYES) . ^^^^§152 

Alt. mmi smmicjjL^i^xyiy-^^rcitx'rTV 

y^^-^m^^^ (S 2 8) o tch7^\-i. mM \ ^if^^ 
km/hcOiijSWStO^iiSil 8TfeD. :6^0*|^1 4 £0 

^HcOjif^^ff ^ C^tcj;0. rni^l 4 co^tf 5 
0 k m/ h tXTt^: ^ ^ cfc 3 iifiSiJW^ff o o ^0 
[0 112] ^liiimS^^^fSbTV>:^l^^*iJKfTb/c 
tf^ (S2 6T^NO) . ^/cti. 7^U~^^/c^X-rT 
U>^cO»f^;^ff^-D/ct^ (S 2 8) . ^tfH»g[5 2 4 

mm'o{%^^^\%\^x\.^^t^'^h'^mm^^ ess 

(S 3 0-eYE S) . 1^mm^l2 A\t. Xlf-;^2 6 
[0 113] e9gD{i^^^«bTl^^l^^*iJ»Tb/cii 

^ (S 3 OT^NO) . ^fc\tmm?t)^t^\-Mk (S 3 

2) . ^tTM»a5 2 4ti. S 2 2 J^XI^tD^aa^SSig-ro 50 
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[0 114] ±t5co|K0^TCi. ^ftSiJmP2 4;6^::^V- 
4^^3J:tfX-rTUy^tD}«f^^fT^S:ofc:^\ F^^/U 

[0 115] i;^±^Oc^:9^^^3ll^^S>^XT-AtCcfc 

l^tD;^y<^4-eF^'</^l 6com^l^.li^m]35l 
4(Otu7a^^I^^ff^V^. F^-T/U 6(0^^311^^^ 

[0 116] [^gStOJT^fl|4] HI 7^#PSLT. 
W^D^SS^omi4 tc:#.^S^}llE^S^>XT-Ati:. Hype 
rOfnni Vision 1 2 i:. HyperOmni Vision 1 2tC'g'^fl^ 

4tcmi^n. 4cor-^n^'^ffi::/a^Stt^ 
A/D^^t§4 0^. A/D^J^t§4 OtCgl^^n. 

2h. Xtf-;^2 6h. Wt5aagf5 5 2^0to^tcSM^ 

xt^ r u > y iDSW^tT^ o fc 0 -r ^ ^tf S'Jffligp 5 

6i:. A/D^^t§4 0^^cfcr>MtaLag[^5 2tcM^$ 

:^ ;^ ^ 4 Titft ^ n^cB^ft ^ . mmmm^ 5 2 cfc 0 

3-WF. ijP)ia$3<fctfX7"TU>^"« 

^i^^Bf^^ij'^fe^"r^iee^B4 3 ^^^Oo 

[0 117] HyperOmni Vision 1 2 ti. ^Sfiom^ 1 

[0 118] ^/c. HyperOmni Vision 1 2 O^gfuB 
ti. ia9^#figbTHf50^bfc Fv-r7V:3-^^^coHyperO 
mni Visionl 2(omM\tmhnmrr:1h^fc}^^ mmtM 

1 otc^-r^9^p*ft"efe^o 

[0 1 1 9] g|l 8^#P.§bT. ^^Jllc^ili/XxA 

/D^}^}^g4 0^/rbTHyperOmni Visionl 2cfcD?SiA 
^n/cBftf«j (mi 0) tt;af*5<):miliJ75"f7:>»«^ 

^mt^-rm^^ti^ti^^ (S 4 2) o ^tf»JffllgP5 6 

ti^mm^^ (s 4 4) o mmmmm^^^mL^rh^ 

^V^S'&tCti (S4 4TNO) . xe-:^2 6;^}>e)C>^ 

mtiitiitn^t>'f (s 5 0) . s 4 2icm^o 
[0 12 0] mmv^^mn^^^mLrcm^icit (s 4 

4TYES) . ^ffS'J®g|5 5 6(^. :^[i5l 4 £07?fp]*i^ 
t5(Dmi*5j;t/X-r7U>i7^'£Omic}:D. F-^^/U 6 
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(S 4 6) o K^-f/U 6;6^|5tS*^0^ 

4 6TNO) . X 2 6 7b^60^fgai:^jmf ^t^-f 

(S 5 0) . S 4 2t^:jBAj^o 

[0 12 1] F-^^/U 6;6^|5*TyftOfe;5;^fpI^i*Cffi^ 
M^R^^S'p^bTl/^^^^tCti: (S4 6'r'YES) > 

Xtf-:^2 6:6^^#$Sffi±;^tT^l/^ (S4 8) . Ilffim 

ummi^m^i^rcm^K^t (s52-cno). S42tc 

Tb^^^-r. F^Y/U 6;^3^^XT-r U V^'^itf'^bT*:*^ 
^S^tT^*5 9^b/cii^tCti: (S52TYKS) . ^ 

4C0:/U-^^o<^tJ^^XT'TU>'^^^ii!l*J^*r^ (S5 

4) o ^t^ti. S 4 2tC^;g)o 

[0 12 3] ^'^m(OBmK\^^^'^±^ 

[0 12 4] ±M<r)mm^^\t^ ^m\Ym^s e^b^^r^V- 
[0 12 5] S/c. ±ai(OHyperOmni Vision 1 2 

mmm^ 5 2 T(DPi^£t^coime*^ ^ t^tcst^^ij^iE 
[0 12 6] mmmms] m 1 Q^MSbT. 

m<Dmmmm 5 tc^;S^|l8B^±i/X-r Ati. HyperOmn 
I Vision 1 2 HyperOmni Vision 1 Zlc^^n^io?^ 

X^^mi^^h. A/D^i^^3S4 Otc}g^;^^n. "rV^ 
;l/-r- ^ (Oil® -r^- ^ ^SaH b T . mi^ 1^ fD3llM*5 cJ; t5 

%n'A<o^m^-^wMt^mmm%'^^ 4 i:. xtf-;^ 

5 4cDlS^S«*Stt^h^ttc. *i*:i7)S»ji^9i4oJ: 
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t>w^osa^mi^H^ia^b^i/^^gj;D§tt. 
ti: f -Ts. ^(omm'f^A •^-^mx^tix.x^^ \t b 

Ti/^^^Jt^Xtf-;^ 2 6 ^ «9M^m^T^»«fiJ^^ 

T^fS^gM4 6 ^^^Oo 
[0 12 7] HyperOmni Vision 1 2 ti. HSgomil 

10 IKH^brctcDhfp]«T^^^/ci6. f^^0^ti:^3M^^V>o 

[0 12 8] ^/t^ HyperOmni Vision 1 2 (i^ :¥i^^m 

'So 

[0 12 9] ^2 o^#H§bT. '&mm±:^W(o^^{x 

\X^(0^o\^mVr^^o m{W^Mtl^ ^\t. HyperOmni 

Vision 1 2 ^^^-nz^^^m^'oMm^n(o%m.^^xs 

^fi^5^tO^*#^lSIS5b. ^^DlS^^m:^^^ (S6 
2 ) o ^*li¥iJ^^S 5 8 ti. plfSmJlgl^ 5 4 cfc D 

m^i^mm^rtri^-rcK^r^m^ic (see^^No. s 

6 STYE S:^)^OS 7 OTYE S) . X\£—:^2 6^K) 

mnihti^mso (S7 2) o ^(om. sqaicu^o 
mmicA^m-Dri^^m^ (see-eYEs) . ]S:mc 

bTti»;^^AP^T43^'r;^>0]5a^:6^^«|^^nTi/^^V^ii 

^ (S7 0TNO) Jcti. W$B*iJ^gM5 StiXlf-:^ 

2 6ti^^(Dm^mt]i^tmj:t^^^\^^ (s 7 4) o 

S 6 4 tcM^o 

[0 13 0] i;(±(OJ:^tc*ilMtomitc{3^^S»:5± 

# *S e> ^ $ /c Sfi^^ ti: "f t- ^ H c?:>Jt!?51{^ffl ^ 
m(^tc>r^bT:feJ:(?bTi/^;i>^^t<:ti:. mm^lbtir 

[0 13 1] ^4b\ ±}diOHyperOtnni Vision 1 2<i:DtB 

[0 13 2] ±mLrcmmm3miic%^ Fv^yi^n 

^5g(OJg|g2~4tc{I^^S^il$K3£M>^X-rA43 
cfca*^ffl(^)ff^^5tc1l&^iSI8K±i^X-rATii. ^^fi 
*i«-t:>-9*^bTHyper0mni Vlsion^ffli/^/c;b\ ±aiO 

0^fc^75■^u^I^'try^t (COP I S) . SiftS^^-^ 

50 m^^^fc^y^mm'^y^. i^rc{m^^'9-^m\^'rc± 
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[0 13 3] ^fc. M^m^^—s^mi^^ixt>^Ks 

[0 13 4] %mm^w^\\^\%^'^'y^~y^ 

[0 13 5] ^iLiiriTi^^nrc^j5Som^ti-r-<TC);S'r' 
[^2] zmrnmin^Mm^^m-d^^^o 

[HIS] ^:^{41gM-tr>'-9-HyperOmni VisloncoS^^^ 

[0 4] ^PBWcOffiMC>i;S^lSifa±*^^C)^»;;S^ 

[He] *5P;jcoy;iffiOJgfl 1 

[0 8] ^:^e^iK■fe>'+^HyperOmni Vislon-Cffi^^n 
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[1119] ^T^fu^IK-try-^tHyperOmni VIsioncO^MfSB 

[HI 0] ^IHfSfi^^ML/c^TjfuffiM-t^^^tHyperO 
mn i Vis i on TtSft $ n W^tO-^iJ ^ ^ f HI T ^ o 
[0 11] F^^yi^n-^^co^cOfifiC>1gfiSc^^'r0"e 

[0 12] *%0^to^sstomi2tcjf-i,^^jite^s^> 

X X A It j^g; ^ t* 0 ^ c 

[0 1 3] 01 OtC^-riSift^S^fO:^V^c}:9ti:'^^L 
[0 1 4] *f80^(O||SgCDJBfi|3tC'f^^S^}l$E^Si^ 

X -r A ^-r 0 ^ o 

[0 1 5] llifgiSai!fia5 2 2T'MT^n^MO:7a-^ 

[0 16] ^tTffliagP2 4TiifT^n^5aiio'7n-^ 
[0 17] if.mmwi^m^m4\-^{%^'SL^mi:^m.^ 
[01 8] ^^ate3^^v^xxi:.T^tf^n^jaiifo>' 
[01 9] imw^(o%mmm^\^\%^'^Miz^^7-'f 
[02 0] ffisiKrihi>'XT-A-e*tf^n^saao7n-- 

[02 1] i;^^cDS^M$E^Si/Xxi^O5^lil0Tfe 

[?5^<7)|^i0^] 
4 ti^'y 

8 ^ffllffi^-^— 
50 1 2 :^7^IMm'tr>"9"Hyper0mni Vision 

4 0 A/D^^t§ 
4 2 IBii^g 
4 8 
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